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ABS^BACT 

TO investigate the draiatic x«d action in the 
discriainating power of reading tests with children above the ages of 
10*11 yearsr a test was devised based ca the GAP test, itself based 
on the close techniqee shown to be effective in assessing reader 
cosprehensioa. The GAP tests ceguires the reader to supply words 
deleted fros a passage of eontinoons fxcse. Oeletions were selected 
froB woxds^ shoi^^o be totally redundant fros experlaents with fluent 
readers (628 education students at ledron Teacher's College, 
Aastralla, who were given copies of 192 different Test forss) . 
Perther ezperisentation was cobdacted with 5,&05 students , grades 
2-12, which showed that even whtk l^^ose passages of goite high 
readability (diffienlt reading) w«xe weed in clcM-type tests, 
diacrisiaatory power deteriorated in children aged 11-12 years when 
words whose rednndancy was virtually 1C0X (totally anasbigacas to 
flaeat readers) were selected for deletica. farther research 
indicated that if words were deleted whose estisated redaadancies 
were less thaa 100S, diecrisination between readers was saintained ap 
to ages 16-17 years. (Tables of ezperiaental data, references, and 
test instructions are included. ) (Df) 



••e4ie««««««««e««ee««««««««*«««eeeeeeee*eee*eee*«******e********««««««** 

* . Bepcodoctions supplied by BOBS axe the best that can be sade • 
4> < fros ths original docaaent. * 

ee'eee««eeeee*e««««e««*«««**««eeeeeMe**e*e***e*****ee*e*«************«* 




i 



U$ OEPAHTMtWTOf Mf ALTH 
EDUCATION* WCL^ARC 
HATlONAU INSTITUTE OF 
eOUCATIOH 

THIS 00CUV6NT MAS 9EEN ftEPRO* PfHMl,,5IOr, To HFPMnfj'jcp JHIS 

OUCEO EXACTLV AS REfEfvED PPOM MATTRial l^ MICROFICHE ONLY 

THE PERSON OR ORGAN ZATiOn QRfOiN HAS BEEN GRAN f U P r 
ATlHG IT POINTS 0»= VIEW OR OFiNiCNS 

, STATED oo NOT NFrESSAR.LY REPRE- Johp MrT^nH 

SCNT OPPIOAL NATIONAL INSTITUTE Of I TU il i TrVM l . . 

^ EDUCATION POSJTiON OR POLICY Jonathan AnHf^rcon 

DEV^LnPf.!FNT OF A STANDARD READING TEST DESIGNED TO Anderson 

DISCRIMINATE EFFECTIVELY AT TF€ ADOLESCENT LE'J^r ZoZ^^^r^^l^l H-.ouRct. 

USERS OF THF fM\L ^rSTF.V 



John McLeod, Ph.D. University of Saskatchewan, 

Saskatoon, Canada. 
Jonathan Anderson, Ph.D., University of Nevy 
Q England, Armidale, Australia • 

sO 

A remarkably general and ubiquitous phenomenon which is found in the 
ineasurement of reading ability is a dramatic reduction in the asts* 
^ discriminating power with children above the age of ten or eleven, 

O This stems from the leveling off of mean raw scores at these ages. 

UJ (University of Reading, 1971), 

The GAP Test (McLeod, 1956) which is no exception to this phenomenon, 
was constructed on the basis of Taylor's (1954) Cloze technique, a 
method which numerous research studies (e.g. Bormuth, 1967; Anderson, 
1969) have demonstrated to be a valid method of assessing reading 
comprehension . The method requires the raadar to restore words that 
have been deleted from a passage of continoous prose. Deletions in 
the GAP Test were selected Tiw words that had been shown empirically, 
fi?om experiments with fluent reaSfeirs, to be totally redundant. 
(McLeod and Anderson, 1966). 

However, further experimentation revealed that even when prose passages 
of quite high readability levels —i.e. passages that are difficult to 
read — were employed as cloze-type testa, discriminatory power still 
deteriorated with children aged eleven or twelve years when words whose 
redundancy was vlrtuaUy one hundred per cent (i.e. totally unambiguous 
to fluent readers) were selected for deletion. 

Further pilot studies showed however that if text were mutilated by 
deleting words whose estimated redundancies were significantly less than 
one hundred per cent, discrimination between readers was maintained up 
to the sixteen or seventeen year level. 

Selection of Prose Passages; 

Twenty-four prose passages were selected, each of approximately two 
hundred words, as a pool from which the fin^ test passages would be 
chosen. The prose passages themselves were extracted fttsm sources 
ranging from children's books and periodicals to adult novels, historical 
and blogra^^hical works (McLeod and Anderson, 1972). The general 
principles on which the passages were selected were that the English 

^ should be beyond reproach and each passage should constitute a complete 

\ unit in itself. 

^ BEST AVAILABLE CO'^^' 

VI 
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Eight cloze-type versions of each passage were prepared: for 

the first version, the tenth and every subsequent eighth word 

was tteleted; for the second version the eleventh and every 

subsequent eigth word was deleted , et cetera, so that in the ! 

eigth version of a given passage, every word,apaurt from the 

introductory ten words, ras deleted in one version or another. ; 

In all, therefore, multiple copies W83re prepared of 192 (8 

vsrsions of 24 passages) differant test forms, each test form 

being printed on a separate indexed sheet* Test booklets werb 

made up containing a version of sixteen of the twenty-four | 

paesages. The serial order in which prose passages appeared | 

in different test booklets was balarced in order to offset any 

possible constoiit error effects due to fatigue and/or practice. 

The try-^out test booklets, therefore, were ^terogeneous in 
nature, differing from each other in the passages sampled, the 
words deleted within the passages, and the order in which the 
passages were presented. The front page of each try^ut test, 
however, was identical for all test booklets, consisting of the 
same demonstration and piractice exercises. 

Initial Try^t: 

The deleted words in the final version of the test were to be ! 
selected according to their redundancy as estimated from the 
responses of fluent readers. With the kind permission of the 
Director General of Education for Queensland and the cooperat- 
ion of the Principal and staff of Kedron Teacher's College, 
Brisbane, the authors ~ ably assisted by colleagues of the 
Fred and Eleanor Schonell Educational Research Center, 
Uhivereity of Queensland ~ administered the try-out tests to 
all 628 teacher trainees in the College. 

In order to ensure that all students attempted all sixteen 
passages in the hour available for each session, they were 
inforrad at three minute intervals, that they ought to have 
conpleted another page. In the event, it turned out that the 
tim available was more than adequate and most of the students 
had conpleted ths test well before the end of the allotted 
period. (For test instructions see Appendix A). 

Data Processing of Try^-Out tests: 

Because of the scrambled nature^' of the try^KHit test booklets, 
it was first necessary to take the test booklets apart and 
reassendsle the ten thousand-odd pages into %92 sets according 
to passage (24), and particular deletion versiiou \d). The 
number of conpleted test forms in each set ranged between 
forty and fifty. 
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Responses ware recorded on punchad cards and the data 
processed by computer. The resulting analysis includsd a 
print out of the proportion of correct responses (i.e. 
restorations of the original deleted word) for each deletion, 
together with'the estimated redundancy of each work. The 
relative uncertainty, and redundancy, of each passage was also 
computed. The distribution of fluent readers' responses to 
on3 version of passage A9 (se^ Appendix), together with 
caliculated redundancies, are set out in Table 1. 
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Table 1 

P nttan i of ftgapo n sBS by Fluent Readers to Tiy-Out Test Passage Nd.A91 

Qsletion (fcjnber; 

2 3 4 5 6 : 
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Soldiars 1 
Londoner t9 
nobility 1 
nil 2 
clear 1 
6imn 
royalty 
French 
gentry 
Icings 
lords 
royall^y 
king 
lads 

anfajlanc 
rich 
Scots 
nobles 
upper 
sristocr 



Hedundancy of passage: 



36.56 



R Bi t» n t a gB D iA Y Bcfc t 



19.63 



46.34 



9.76 



and 
vould 

both 
nU 
ixit 
yot 



34 
1 
1 
1 
2 
1 
1 



79.66 



82.93 



notion 
spirit 
herd 



king 

fanffxirt 

the 

people 
air 

history 
prida 
feeling 
foe 



6 
3 
6 
10 
3 



4 



dty 




37.22 



9 76 





61.30 



14.63 



80.35 



31.71 



aoriglnBlly dbleted are indicated by undBrlining. 
for all raapona ea only the first eight letters are pr i nted . 



79.23 



39.02 



the 40 
been 1 



court 
palace ' 
cross 2 
castle .' 
nil 
road 
place 
scfusre 
folles 



9S.91 



97 .S6 



56.18 



51.22 



10 



11 



12 



Table 1 

(Continued) 

Deletion Number: 
13 14 



empty 
clear 



15 

10 

move 2 
resound 1 
nobles 
cro»/d 
nil 
shake 
stir 
quieten 1 
fill 3 



1 
2 
4 
1 
1 



civilian 1 



Redundancy of passage; 



weary 
hungry 
aged 
cold 
poor 
old 
alv«ys 
sad 

working 
busy 
homeless 1 
apatheti 1 
patient 2 
crork 
the 

dogged 
revere 
liston 



2 
9 
2 
3 
1 
6 
1 
3 
3 
1 



45.79 



29.27 



Percentage correct i 



36.59 



would 27 




62.78 



65.85 



the 40 
haros 1 



96.91 



97.56 



death 


3 


fear 


1 


winter 


7 


darkness 2 


nil 


o 


night 


5 


this 




war 




France 




cold 




destruct 




however 




they 




the 




danger 




all 




friend 




mist 




rain 





20.43 



12.20 



Number of sub.jecta; 41 







16 




17 


wixn 


A 


unuersuci 






like 


6 


nmnt irrf* 

tunuui 1 V 


1 
1 


r^oin^flnpo 1 


and 


2 


passxon 


1 


t:hp 1 


that 


1 


1 eexxny 




^ nno^ 1 


fear 


1 


SoilSB 


in 


tn 2 


suddenly 4 


as 


1 


bnus 1 


in 


4 


pity 


1 


UUi ins 1 


inside 


1 




1 

1 


mw 3 


at 


1 


unougnb 


1 


xn 1 


then 


3 


ouiyUisn 


1 


hrpa\/pl V 1 


even 


1 


nxx 


w 




sharply 


1 




1 
1 


^awui i 


as 


4 


sensabio 


4 

J 


ricVEr i 


but 


1 


w JLwl 1 


1 




nil 


3 


concern 


1 




guletly 


1 


pang 


1 




certainl 


1 








slightly 


1 








such ' 


1 








24.70 




41.80 




53.52 


9.76 




?4.39 




56.10 
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Item Seloctlont 

^roffl th« data yielded by the fluent readers, it wae necessary to 
cteolde (a) which passages to use in tha final tsatf and (b) which 
iwords should be deleted within each passage. Four primary 
principles were esta|3llBhedt 

J 

(1) The paB8aufe6 comprising the test must be of appropriate 
interest and difficulty le.-el. 

(2) As far as possible, early items in the test should be easy 
and the later items should bo more difficult. 

(3) Distraotors — or raore corr0:;tly, error responses in what 
was to be an open ended tpst ~ should be as evenly 
distributed as possible. 

(4) There should be .at least four words of context between 
deletions. 

1. Appropriateness of Material s The suitability of all passages 
used in the try-out test had been assessed and discussed from the 
first stages of designing the teat, before the results of the try- 
out testing were known, but there could be no certainty that all 
paoaagee would stand up to quantitative analysis. As it happened, 
an adequate number of wrti deletions, covering a range of item 
difficulty, could have been selected frc^ any of the twenty-four 
paaeages, but it was estimated that six passages would yield a 
Bufflclent number of items to produce a teat of acceptoble 
reliability. Two equivalent teats were therefore prepared, 
using twelve of the original passages. The passages to be used in 
the teat ware selected so aa to moke for a variety of proae typsa 
(e.g. children's literature, novels, descriptive and sclGntific) 
end, for the most part, passages of easier overall readability, 
according to empirically determined redundancy, rrere chosen* 

2. Gradation of Item Difficult y. Unlike a test r;here individual 
item placcrant can ba changed" freely, the test undsr coinstructlon 
was to be made up of itema which Qr3 themselves ombeddrd in 
continuous prose. This constraint is an impediment to smooth 
gradation of difficulty. Passages that had been selected for 
Inclusion in the final test t-ere arranged in increasing order of 
readability level as cstltnated from the responses of the fluent 
readere. Within ths passages, dsletlons ware chosen in such a 
way that the proportion of difficult items was high in the later 
passages and low In the early passages. 
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Each deleted word was classified according to difficulty* 
if rrinety to one hundred per cent of fluent readers reproduced 
the correct word, then difficulty level was designated as A. If 
sixty to ninety per cent of fluent readers reproduced the"* 
correct word the item was rated as of 8 difficulty, while if 
fifty to sixty per cent of fluent readers reproduced the correct 
word, the item wa? rated C. The distribution of difficulty levels 
of deleted words in each form of the final test are set out in 
Table 2. 



Table 2 



Distribution of Item difficulties in GAPADOL 



Form G 
Difficulty level 



Form Y 
Difficulty level 



Passage No. 


A 


B 


C 


A 


_§ 


C 


1 


7 


2 


Q 


5 


7 


0 


2 


3 


12 


0 


3 


9 


2 


3 


5 


6 


3 


2 


6 


3 


4 


4 


7 


2 


3 


8 


3 


5 


2 


7 


4 


5 


8 


2 


6 


2 


7 


7 


1 


10 


6 


1 - 3 


15 


20 


3 


10 


22 


S 


4-6 


8 


21 


13 


9 


26 


11 


Total 


23 


41 


16 


19 


48 


16 



3, Equl^^distribution of Error Respon ses . In a multiple forced- 
cholca test, it is generally desirable that no distractor should 
attract a significantly high number of error responses. The 
Qapadol tests are open ended so *'distractors** are generated by the 
mspondaas themselves. For sxample, the first deletion in try-out 
pasoaga A92 (sea Table l) elicited a wider variety of low 
incidancG anror responses end is, therefore, a potentially good 
but difficult item. On the other hand, delation number 10 attracts 
the response "^cleer" almost as frequently as the response "empty^, 
and is therefore not satisfactory. 

The criterion according to which a deletion vras deemed to be 
accaptoble was thatr.tha eatinated redundancy should riot be higher 
than the proportion of correct responses « The validity of this 
rula of thumb is demonptratod in Appendix C. 
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Context between cir^letions , Tradition=il test theory requires 
that the item in th3 test shauld bs statistically indtpendsnt . 
It has been empirically daterTninsd (Anderson 19S9) that this 
condition is satisfied if an every-fifth deletion system is used 
(i.e. if there ere at least four words between successive items). 
There is in the final test only one exception to this general 
rule: the first word in the third paragraph of the second passage 
of Form Y, 

In summary, v.'ordn to be deleted in the final tests were selected 
in such a way that: 

(1) they elicited on acceptable number of correct responses; 

(2) a larger proportion of words that ore easy to restore ^lere 
included in the early passages, and the proportion of more 
difficult items was increased in the later passages; 

(3) the proportion of correct responses by fluent readers was 
higher than the redundancy according to the fluent readers; 
and 

(4) there are never fewer than four words between successive 
deletion? . • 



Pilot administration of GAPADOL Tests; 

Before standardization testing itself, the oroposed GAPADOL tests 
were adminstered to one class from each grade level in an elementary 
school and in a high school of the Saskatoon public school system. 
(The public school system and the ssporats school system are 
Irdspendent of each other, so that no child involved in standardiz- 
ation testing would be involved in any testing carf'iod out in a public 
school). The purpose of the pilot run was to check tho adaquacy of 
test instructions, to establish guide lines with regard to timing and 
to confirm that a test of six passages would yield an appropriate 
spread of scores. Soma estimate was also required as to the likely 
discriminating power of the test at higher grade levels. 

These objectives were achiawa(;lfiTdth significant discrimination being 
obtolnsd through Groda Eleven. Half an hour was deemed to Ds an 
appropriote time limit for test administration as most 6f the 
chil(dbrsn had completed the test within this period; In fact, many 
chUdren in hxghHsr grades completed the test in a much shorter time, 
eo thatt for children in higher grades particularly, the test is 
essentially a power test* 



1. There is one exception to this condition; the first vord of the 
third paragraph in "Polluted Baaches" (Form Y). 
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Standardization i 

The GAPACX3L tBsts W3Te standardized on tha entire Saskatoon Separate 
School population of ovar 5,000 studants, in Juno 1970. A preliminary 
mseting of school principals had been convened to discuss the test and 
its rationale, and was followed up by the distribution of notes 
concerning tha background of tha test and gensral instructions to all 
aeparato school teachers. (See Appendix D.). Appropriate numbers of 
teats were packaged in separate envelopes for each cl&sSf together 
with a specific set of instructions '''or each teachjr relating to test 
arlroinistration and making. (See Appendix 0,). 

Class teachers administered the tests, adjacent children answering 
different forms of the test to obviate the risk of copying. Each 
child^s raw score, together vdth his ur her date of birth, was recorded 
on previously prepared sheets which were returned by school principals 
for analysis. 

Children from grade Two through Grade Twelve were tested, 2,751 
answering Form G and 2,754 answering Form Y* 

The data were processed at the Institute of Child Guidance and 
Development (Saskatoon), on tha Hewlett-Packard computer, which had 
been programmed to convert raw scores into percentile ranks, at five ♦ 
point intervals. 

After smoothing, by running averages. Saskatoon local norms mre 
produced for the tenth, fiftieth, and ninetieth percentiles. A 
coraprehensiva table of nomalized standard scores, i.e. quotients, could 
have been derived, but such indicies ~ with their appearance of high 
precision ~ can be misleading. For older children particularly, tha 
functional value of a reading test is to determine v/hsther a child's 
reading level is inore or loss average for his age; if it is not, than 
teachers and reading specialists nsed to be able to estimate tha 
extent end seriousness of the rsading natardation. Calculating the 
raw score corresponding to the madian parcentile z'artc establishss the 
norm or average reading performanca for a child of a given age and 
knowing the raw score which corresponr^s to th3 tonth percentile 
provictes a reference marker which makes it possible to relate a 
retarded reader's psjrformance to that of the poorest ten per cent of 
readers of his oot age. As a reference at th3 highsr ranges of 
reading ability, tho raw score correapondinb to tha ninetieth 
percentile was providrjd, in ordar to facilitate identification of 
outstanding rsadars, i.e. those in tha top ten p3r cent of the populat- 
ion tested. 



. • . • 



10 




12 





# 10 ♦ 



It remainad to estimrte ths degrcs to which 3a£:kataon normc might 
be roore generally applicable. The author has argusd elsewhere 
(Schonell and McLeod 1952> p. 8) that it is exceedingly difficult 
to obtain a nationally (let alone internationally) represcjntotive 
and valid sample and the practice of simply selecting children 
arbitrarily from three or four different t'^'pea of area is of 
doubtful validity. An alternative approach is to relate the data 
and rorras of the test to be standardizt^d to the norms of an 
existing test or tests whose validity has been established, 
least, such a procedure ensures that norms of the test beir 
standardized are compatible with those of the established test. 

The obvious test tc use in the present Instance, was the Gf^P t*jst 
(McLsod 1965)and, for this purpose, both GAP and GAPADOL tests 
were adroinistersd to every child from Grade Three to Eight ir on 
slementary school of the public school board of Saskatoon. The 
order In which tests were presented -i.e. whether GAP or GAPADOL 
was administered first ~- was balanced over the classes. 

In view of the anticipated fact that many children in the higher 
grades would be approaching or achieving beyond the ceiling of the 
GAP test, it was decided, a priori , that GAP ar- GAPADOL raw scores 
WQUld be ooinpared only for those children ?^coring not more than 25 
on the GAP test. 

Published GAP reading ages (McLeod 1963) were correlated with 
GAPADOL (Saskatoon) norms, and a highly satisfactory correlation 
coefficient of 0.78 was obtained, with ragression linear. The best 
fitting straight line relating thfj two sets of norms had a slope of 
almost exactly unity, indicating that the Saskatoon Gr^PDOL figures 
were almost constantly 3 months more pessimistic than the existing 
GAP nonns,(McLeod and Anderson, 1972). 

The local Saskatoon norms were modified appropriately and, at least 
up to a reading age of apprwimntely eleven years, the GAPADOL tests 
yield reading ages which are: as comparable with those from either 
form of the BAP test as are the Uio GAP testft' vdth each other. At 
higher age levels, of course, no direct cora^farlaon between GAP and 
GAPADOL Is possible. 

Reliability^ and Validity 

The validity of the Cloze-type tests has bean well established over 
the years. As was roportod in the previous section, e product moment 
corrolation of 0.78 4Qs obtaine«< dat.vaen GAP and GAPADOL tests, for 
children nith reeding ages un to about lOjr years. ' 
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RaliGbility has been Bstifnatsd by computing ths internal consistency 
coefficient fHoyt, 1941 ) at alternate e^ade levels, from Grade two 
t' "ouBh ten (Table Three) • Groups of approxlrratoly fifty children 
were used for the calculation of reliability coefficients, which 
were corrected for attenuation. 



Table 3 

Reliability and Standard Error of Individual Scores 

Form G Form Y 

Age Ranges Reliability Standard Error Reliability Standard Error 

7,3 - 8.3 years 0.64 2.57 0.92 2.35 

9.3 «10.3 years 0.91 3.09 0.87 3,44 

11.3 -12.3 years 0.93 3.51 0.89 3.49 

13.3 -14.3 years 0.92 3.55 0.90 3.63 

15.3 -16.3 years 0.91 3.45 0.91 3.72 

By administering both Form G and Form Y within a v/eek or so, and 
averaging the two estimates of a child's obtained reading age, 
reliability of the overall assessment can be effective'iy increased to 
0.93 for younger children and to 0.95 for older children. 



Acknowledgements 

Grateful acknowledgement is roads to Mr. Walter Podiluk, Dlrectcr of 
Education of the Saskatoon Separate School Board, and to all 
principals and teachers of that system, for thsir cooperation in the 
standardization of the GAPADOL tests. Thanks also due to Dr. Fred J, 
Gathercole, Director of Education of the Saskatoon Public School system, 
and to the principals and teachers of City Parlc High School and of John 
Lake Elementary School, Saskatoon. 

For assistance and collaboration in the original calibration of reading 
passages used in the tests, appreciation is extended to Mr. G.K.D. Murphy, 
then Director-General o^ Education for Queensland, to the Principal and 
staff of Kedron Teachers ' College, Brisbane and to tha staff of the 
Fred and Eleanor Schonell Educational Research Centre, University of 
Queensland « 



References 

Anderson, J. Ap gllcatiq n of Cloze P rocedty e to Eng lish iBarned gg a 

Foreign Lantyj agg. Unpubliofed Ph.D. thesis, University of New England, 
Australia, 19^ 

Bormuth, J.R. Design of Readability Research. Procegding s of tha 
Eleventh Annunl CGnvention of the Int grnattonal RBadinq Association. 
11.1, 403-4^3, 1957. 

McLeod, J. GAP tests end Manual. f.^slbourn3, Hainamann Educational, 195S. 

ItaLBod, J. end Andsrson, J. Readability Assessment and Word Redundancy 
of Printed English. Psycho lo*?ical R^on rts. IB, 35-38, 1956 



♦ 12 ♦ 

McLeod, J. and Anderson , J. GAPADOL Rpadlnq ConinrGhenslon and Manual. 
Melbourne, Heinemann E ducat ional, 1972 

Schonell, F.J. and McLeod, J. Wlrral Mechanical Arlthrrstlc Tests and 
Manual , Edinburgh. Oliver and Eoyd, 1962. 

Taylor, W.Lo Cloze Procsduro: A New Tool for Measuring Readability. 
Journalism Quarterly . 30, 415-433, 1953. 

University of Reading, School of Education. Reading Tests. 1971 



APPENDIX A 

Redundancy Estimation of Original Passages 

Test Instructions 

Don't open your booklets. 

You are today cooperating in a piece of research, and one of the by- 
products of that research will bo a reading test which can be used in 
High Schools. 

Today we are interested in whether thn passages wa have gathered 
together are suitable as test material. We are not tcisting your 
reading ability, but rather using your reading ability in order to 
teat the 'test material. 

The booklets in front of you contain sixteen passages each of which 
has some words deleted in the sarre way as the practice example on the 
fJront of your booklets. You have to write on the lines provided at 
the aide, the one nork that is rnissing from oach blarik. 

The words deleted have not been specially eelected, but rather chosen 
at rwidom. Sorae aro very simplo and obvious worda, for exarrple, 
definite and indafinlte articles. You fid^^rtTfie able to think of 
several words that could adequately fill sorre blarike. However, you 
may find a fen blanks that ore siripiy impossible to replace. In every 
case, Just try to find ths one nord t/hlch fits the sense bsst. 

Let^s do th9 practice exan:;.as on the front of your booklet to give you 
the idea , 

One of ths graat exports of South Vietnam has always 
(pause) Anarican optimism. 

What is the word that is missing. You might notice that the blanks 
vary in length according to the v.ord that has been deleted. Well, 
what is tha first miscing VM3rd7 {Obtain •bean')- V^ite the v.Drd 'been' 
on tha 11ns at the sid3 of the paper. (Demonstrate). Let's do the 
second bloPik* 
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Illicit II 



One of ths great exports of South Vietnam 

has always b2Gn A^isrican optimisra, but this tins 

I thought (pause) I returns'^ that it would 

What rard should you write on ths nsxt line? (Obtain 'when'). Now try 
the rest of the blanks in that passage for yourself. V/hsn you have 
finished, put your pens down, and do not turn over. (Check answers. 
Bring out in discussion that •illusion' - the ansrar to the fourth 
blank - is very difficult, i'* not impossible. Don't be afraid to 
guess}. 

Wall, that is the sort of thing we v/ant you to do. Just v/rite the 
one mrd that you think should be in each blank, on the line at the 
side of the paper. Please write clearly, and please v/rite your 
ansiver on the same line as that in the passage from which the word is 
missing. If you make a mistake, cioss out the wrong anssver and write 
your new answer clearly in the rig^t place. Don't waste tims with 
any particular blank. MaU<e an intelligent guess. 

It is important that you have a go at every passage, so try to keep up 
a steady pace. As a guide-line, 7 v/ill tell you from time to time 
what passage ycu ought to be on. 

Are there any questions before we begin? 

APfENDIX B 

No, A9 

"LONDON CAN TAKE FT 

Thtse were the days when the English, and particularly the Londoners, 
who had the placa of honor, were seen at their bast. Grim and gay, 
dogged end serviceable, with th3 confidence of en unconquered people 
in their bones, they adapted thnmsalvas to this strange new life, with 
all its terrors, with all its jolts and jars. One evening when I was 
leaving for an excursion on the East Coast, on my v;ay to King's Cross 
the sirens sounded, the streets baaan to enpty fsxcept for long queues 
of very tired, pale peoplo, waitinn for the last bus that would run. 
An autumn mist and drizzle shroude^ the scene* The air was cold and 
raw. Night and the enamy v;ere appixDaching. I felt, with a spasm of 
mental pain, a deep sense of the strain and suffering that T;as bt^ing 
borne throughout the world's largest capital city. 
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APPENDIX C 

Relation of Redundancy to Proportion of Correct responses R^, 
and Ng , , — N^^ respondees give in correct responses R2 , R2 » 

— R^ respectively. 

Consldar the expression Proportion correct 

Redundancy 



l^ZlN^ loggN^ J /N loggN 



i-k 



i-1 



loggN 



2n; '°=2'i 



loggN 



loggj^tN-^y X (Ng) X (N3) X - X (N^) 

loggK) ' ' X (N^}^ 1 X (N3)^ ^ X ~x (N^)^ 
i.e. N - U^x(N2)^ ^ X (N3)^ ^ X - X (N^)^ ....(1) 



logjN 
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Ideally, for a satisfactoxy item 

and each error frequently is small^ 
^ » t • • • — > 0 

.*. From equation 

N->^N^ X 1 X 1 X 1 X ij* 

i.e. N^^ (2) 

(a) For an easy item, 

frora (2)eiC 1 

(b) For a difficult item, 

< N 

flrom (2), logN oClogN^ 



i.B.«,> 1 



i.e. proportion of correcr responses is greater than Item 
redundancy. 

APPENDIX D 

MEMORANDUM 

TOt School Principals, Saskatoon Separate 3chools 

FROM) John McLeod, Oi^^ctor, Instj-tute of Child ^idance and 
Oevalopflient, University of Saskatchevan 

DATE: April 6, 1970 



6APA00L Reading Tests, Saskatoon Standardization 
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HBrewlth btb test forms, instructions for administration, class 
register blanks and marking keys. There ought to be one set of 
materials for each room in your school. 

The tests have been put in envelopes and it would ba helpful if 
each roomys completed tests could ba returned in its ov/n envelope. 
To facilitate counting, the tests are in lots of twenty-five or 
fewer. That is, if an envelope contains tests of only one colour, 
then there are twenty-five tests in the envelope; if the envelope 
contains testa of tvra colours, then there are tv«nty^five of the 
ncre numeroua tests and a sroaller number of the other colour. 

I trust that you will recall that during the actual test 
adtainiatration, alternate rows of children should be doing 
different tests, i.e. approximately half the children in each class 
will be answering the yellow form of the test and the other half the 
green form of the test. 

I hope that there are no misprints, but there are almost bound to be 
a few tests chat have slipped through which are faulty. If so, there 
ought to be sufficient extra tests for you to be able to replace any 
faulty ones that come to your notice. 

Thank you for your help. 

sinned John McLeod 
John McLeod, Director 
Institute of Child Guidance 
and Development 

JM:dbv 
Encl. 



6APAD0L READING TESTS 
Saskatoon standardlzatlcn, 1970 

General background 

The QAPADOL teste are reading testa based on the "Cloze'* technique 
devised by Wilson Taylor, and which research ha* show) to provide a 
highly valid mQasura of reading corprchanslon. The flrit published 
test to uso a modified cloze tcchniqua in a standardized Instrument 
far meaaurlTHJ reading cor^jrohanslon is Uia senior author's GAP test 
(Jbumol of Raadlng, April 196St IX, 5, p.3S9). n 
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The GAP tests, ho-.vsver, tond to level off for average cniidren at 
about the ag3 of eleven or tv.'slve, end the GAPADQL tests represent 
en attenpt to raise tho effectivo coiling for which reading ability 
rnay be validly assessed. A prelininary try-out has indicated that 
the present GAPADOL tests might bo expected to discrimlnatg up to 
the Senior High School grades. 

Tha tests consist of passages taken from published v^^rks, with 
certain mrda deleted. Details of how and v^iich vvorda were deleted 
have boen published elsewhere. (hteLeod and Andsrson 1970) but are 
too technical to describe in tho present context. Briefly, the 
criterion for a v;ord to be selected for deletion was that a high 
proportion of adult efficient readers should, under test conditions, 
supply the word us^ by ths original author of the pMsage, vtithout 
ainblquity. 

The purpose of the current testing program is to provide norms for 
Saskatoon, based on the Separate School population. It should also 
be possible to compare the appropriateness of tha tost norms of other 
standardized tests which are used locally. 

General Irstructions 

1. Students should anwer the test in pencil. If thay work in ink or 
ballpoint, it will be difficult for them to make corrections in tha 
answer column. 

2. Test should be distributed in class in such a wey that adjacent 
children are ansi»ering alternate forms of the test. As one form of 
the test is printed on yellonr pc^sr and the other on green, the teacher 
should be able to check at a glenco that alternate rdwe of students 
are answering dl^fferent forms of the test. (The administration and 
inetructions for^each form ere identical , so that both yellow and green 
forma con be given simultaneously.) 

3. Prior to the teat, have the namo of the school and the Grade vnritten 
on the chalkboard, as required cn tha front page of the test. 

4. This is a test standardization, which means that if the results are 
to have any validity at all, tha test must be corrisd out under 
standardized conditions. Therefore? 

Please follow exactl y the "Instructions for ed.itinistration" es set 
out on tha sh38t3 accompanying thn teats. Soira teachers believe 
(quits correctly) tfiat they ccn explain to children r/hat it is all 
abc ^t bjttsr than the person who dasigned ths test instructions. 
The irrportant point is, hov.'aver, that all children must recsive 
exactly tha sn'ris instructions . 
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Timing muBt be exact. The GAPADQL is a power teat rathar than a 
speed tost, and many children ^vill corrplete all thay are capable 
of doing v/ithin tha 30 minutea tirra linit. However, please provide 
youreelf with either a etopv/atoh or a watch/clock with a eeoond 
hend. 

5. Many chHdren will finish within the 30 minutes oUov/ed, so have 
some reading or drawing material available for tham, so that early 
flnishera will not distract other students. 

6, Do Not help studants during the teat. If anyone asks for help 
(••What is this word?") Just toll them to try to figure it out, do 
their best and/or go on to the next item. 
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